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(54) ORTHOGONAL TRANSFORMATION CODING 

SYSTEM FOR MULTI-EYE TYPE STEREOSCOPIC 
VIDEO 

(57) Abstract 

PURPOSE: To improve the coding efficiency and the visual 
characteristic by using sets of picture elements at the 
same position or in the vidnrty of the position as to 
outputs from each camera for one block so as to 
implement orthogonal transformation thereby coding the 
result 

CONSTITUTION: Outputs from plural cameras 1 are 
subjected to cell processing t)y using sets of picture 
elements at the same position or In the vicinity of the 
position for one block at a cell processing means 2. The 
relation of position of each picture element in the 
block corresponds to the arrangement relation of the 
cameras 1, and a picture element number changeover 
means 3 selects the number of picture elements depending 
on the same camera in the block adaptively by using the 
correlation of a border between outputs from the cameras 
1 as an evaluation function. Then a con'elation decision 
means 5 decides whether two dimension orthogonal 
transformation or linear orthogonal transformation is 
executed and data passing through a switch 6 are 
orthogonally transformed by an orthogonal transformation 



device 7 and quantized by a quantization device 8 and 
coded by a coder 9. 
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.#^^6 - 1 1 3 3 3 3 



(lf*3«ll ^»<0*>7 (1) i)^h<Otiit)i:m\'^X 

ti, ^(7^7 (1) (DiaeBg#.t^^&bTv^5r 1 
l«*3S4i (1) A»t>©as:t>K©S[#®le 

[0 0 0 1] 

mm±<ommi^m ^mmm. 7*»?>«>tb 

T, WAVELET, T^-^— K Lt?<^)iEi5^^^^ 
[0 0 0 2] 

10 1 10 2 t4«E^*(^ 10 1 SrS^-r^* 

7 1 o 2 tt1gm<@^f-tfeti.r*5f?, 

to 0 0 3] ^:^?^7i 0 2<DSS{ieSr'>U-fo-rt> 
UTV^SOB:, io©;<7p< 7A^t«5t±};^5r>^"^<^BSI->fi■ 
J;5ti-r.5/c*-CifoS, ISoT. r(OJ:5lw*^7l O 
2Sr#Sfcfflv^sr^:^^:J:^). ^^T'UW 1 o 

7 Sra5AFBld5. r <^7^^ i 0 7 Srl,6fi:gSr 

[0 0 0 4] 1 o 3B=&;*^ 7 1 0 2*^t>A;^j$lx5® 
^7^-^' Sr^f ^^t;-r5??^ft:«. 10 4 tt^^^-fklf i o 



;!cSgi o 5-x?^5^^^nfcBi^x— ^'^IrT^'f i o 

7|;::el^Lal-r/c^e)^^:«#Sr^7*5«•§■S■C*)5o 'fe:^. 
7* w-Y 1 O 7 i: bTti. 0iJxli. U'i^'?'*^.^ • 

1 0 0 0 5 1 iiBcoiS^fci: *) . ^M<D^m^^Wf^^ 

fc5v^^i, ibv>-cv>2)®2?(*:i 0 1 Sr, EBfiia. :*[6J 
Sr«l*5it)5^|c/>U-f o-f ^ 9 l o 2 t? 

m^-tito JSfct-^ ^Sfc<^);&^7 1 O 2*^6>t§b^X^C®^ 

x-^^ffitg^^^-fkb. -?/p^7'v^;*.sgi o 4{cj; 

[0 0 0 6] ^<D^, 'BjiiK^'ilfSr^U-ceiilU S« 
^Ra-C-Hx•^y^^7•^;? i 0 5 tc t? (v^-^/u^ 

7'-<>?.7'W 1 O 7tce*:LtB-ro rcDT^^^T'W 1 O 
7lt?!)iLW$tt:fc?*»<^— 0'Ji:l-"Cx SlOtc^fn^^E 

[0 0 0 71 $e>«::. m<ombl.X. mi ll!i*:o^7 
— 0iJSr*-t-o ^K^Uli il-*5V^x, «-§-Sl 0 eicio 



^->y^T j^t mmx»>^o 10 8 tttt+itmse i o 9 
x^^g6x-fc 9 . ^mvrl^^ 1 o 9 r±. 
m:f3^i 1 o--Hi:;f3-r5fc«)<o*o^^^-«^<a:lBth^S:?T 

[0 0 0 81 :L<DX.O^J:mm^^'0 . ±i^Vtc^oi^^ 

Stt. iitati-^SBi o 9^;l±^►*o^7Ae:^et^-^Sr^7 

iiii«l1>--f XSESigRi o 8fj:j;»)Pi«i1>-WX 
tr^^-rSo ^<r>^. -etatf^gpi o 9-r-ii4stf^$rff 
jfcvv jjxD^'^^^ s'^ttJ:*5Si 1 ojcio-CM^iSrffi 

10 0 0 91 fcr ?>-C. iS^. 2 J!fc7cM:?S!^^©4§^. 
1 0 2*^e>«Otil;tl®^ (17 1^— A) SrNxN® 

(JiSSf^^Srff'SJp) o 09, 01 l-C-n^L*:-> 

#Bi*i:fl£8!ii»->;^7"A©??#<t:Sgi 0 3T?tf**:> 




3 

[0010] El 1 2 ^Ct5V^T, 111 tt* p< 7 1 O 2 *^ 

A^m^^<Oy'~- ^ Sri^^b-r 5 i^-ftlg. 1 1 3 fi 2 
»c5c<D4&^j::g-?-(k^(D7^— Sr® 1 3 (a) ~.(c) 

;ig|5, 1 1 4 fi 1 25i:7E{-afe'<^x b^fcT"— {-^ LT 
^^^«??#<t;S:lS-rW^*^^<kl§ (VLC; Valiable 
word Length Cording) "CfcSo 

10 0 1 1] :i<oi5''i^fj*l-±!5s 1 0 

ii:2g^5^fc'5V^H:2 2>C7Eii:?S5^^Sr=ff'ic5. m.iZ^i^<o 
mmthXti^ DCT, WAVELET, T^-^— 

KL^«i^-r-^5j5N i:'©ii:5s^^i-*3v^-rt>. 
[0 0 12] m.^^mmi>v<ti&^it-^ h y s/^^sr 

mni^tc^. mi-itiSi i 2j::io-r»^F-<t:Srff'iv\ 
2?!fc5EW*i^, U!)c5Eag'<S^x:§Bl 1 3{::J;i?:^^-\r^' 
LXli^jci^i^^Lxai^ib. ■siiee^-i-^klgl 1 4(-i 

J^-fk^^t L-rin 6>ti,-cvSM p e g i(0 2 ikTc v c Sr 

fflV^So 0 7>'fti: 0T-^&V^#^<D:>C#$^:<^)i»^-g•t> 

[0 0 13] 1 3iz^^y^^^:y^ 

StbXtt, iStex— ^'«>t4fft-^t>«T. Ell 3 

(a) \z^-tXo^':^i^^^:^^^>"^. 013 (b) 
tw^-Ti mis (c) J; 5 '^i: 

^JJ«.^^>/j;i:*Ai^t>ti.-CVSo ^13 (a) ~ 

(c) icti.4X4m$^<r>:/n yi/<om^iz<:>\,^x<o::^^ 

[0014jgll3 (a) lC^i-vJ:J''U-*^'*^=^-V'i^tt. 
6>iS^ft{a'^i^*!):*|6H;::^^ + >'LriK, 013 
i^rfiili^^t+v-rs^S-c, il^Sf^^i 1 i--<©A;^ 
■5o 013 (c) iw^-Tftl^^^+iTi, i&mi^mti^hnii 
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4 

\zm^X'$>^o 

[0 0 15] #ig^S:^l^i^^>^xA^c*Jv^T 
tt, HI 1 2 [ZT^-rx 0 ti:m.^^^n^-it<otc)t<om^ 

E9|cs^i-;6/'7 1 0 2fiJ::^jfex.e>n. J&y^i 

o 2 feiciii t mmtom-^sz^mn^-mmimtaiyinx 

[0 0 16] 

10 [|6?^iSft|^LJ;5i:i-saiS] tr^t?, t¥?l50#|g 

2d^P>(OLB;tiiii^x— ^tt, mi 0\zt.^VitX ol^Wi 
ifioxv^^) (ta^i^S^vv) t><OAs#v^i v^5#^a*^fes 
ic'bd^*-t>^)-f. 1 O 2d»6>coiif^x— 

[0017] *^pji4. ^<DXo ^i^mK&^mm^n 

*J i t>-mm#t4<^) IS] ± ttd-o fc#BS^5A<^eftfi|<^ii:?SJ 

[O 0 1 8] 

[^s^^s^:-rsfci?)<75^si 0 1 «:*^eg<Di^a:7'D 
y^ST\ ::oEin-*sv^x. i»ais^{*: (n^-^-T) 

30 *J 7 ittv mkm.X&m (lt«:&[fii, 
x3t«:isfcfiKSri§xv>s. 

[0019] 2 tt^^Wb^lftx. r <D*/Wk#e 2 «> 

^;<7p<7 1 >6^e><7>aj;^t-oV^xl^— fi5:;H*fc:fiS*JS:-rs 

y< 7 1 <oieM^^,t*ffSLXv^Sc 3tt®^i@S5:^#^ 
40 &x\ roBimi@S5:^##^3tt, 7 id»b<^m 

;^P.g©^#<Dtag8SrW«Mifct LX, -kyWb#e:2lJ:a; 

m<omm^mfi:>mz^ •? #x.s t)<^xfc-5o 

[00 20] 4 fi 2 ^7t<07'~-^ 1 J!>C7cJ^^m-f-S tc 

50 -*X2ifcjEia3S;^giSrtT'ii5*i^lc:o:UJ:7cafe'<#^ 
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J; 5 2 i!c5cx— ^ + :^*^iSr«J •? 5 1 <D-e 

10 0 2 2] 

51I^<0^-&Sr 1 oot'd s/ ^ i: LT-fe^Wt^tv^, 
[0 0 2 31 -^-LT. ^mnM^^5l,z.X<0 . -fe/Mk^ 

S 4 i ^ 2 j!5c7E7^— ^ o ;^ =3f ^ v::^^*^^ t) # ;^ b n 

[00 24] 

-rSo El2«:2|s:58W<0-|llfefia|<l:5rr:?'a s/>El-C, i 

2 ^rt5v^T, ^^m-r^< 

I O O 2 5 J 2 A B-fe/Wt;^Sr% r <D±Mt^^ 2 A 

tt. l*^tJ<ol±s;'^l-o^^Tlnl-fi[a*fc^i*^^c:; 
x\ '^m-r^mmmmm^^^3AA-h<D±ji^if^hv 

(0 0 2 6] r.<Oi#. ■fev'KkT'o y ^|;:*3rf5#Bi^ 




!|#Ba¥6- 1 1 3 3 3 3 
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^«r. 5Bgx 5BBf 2 s-feo^pt 7 i*5^r'icx.f>tt, # 
l!6»e><oaj;tlSr^ix^ettK„~Ksst 

-aaJ-fo-Siiim (S3-cttipfm^«l:-r&-5*^ 
2=*. 3=, • -, ti'' mmm&X^X\>^) S:, -feyWt^ 
.^2ASr/i-t-^>l's'^V:J^^^2a|Cj;>?, #:!{?;^7l 

SrfP^!gi-«>o 0 3-C-tt, 7lll;'3Kax~K6sO&Jb 
10 {cfc5®*KB„,~KB6si Sr*J6T-fe/Hfc:Ufc::/'o 

[0 0 2 7] ^fc. 3 Att®^®m^#^SX. r©M 

<^*BMSrSffiM#:t LX, ■fe>'Ht:^IS;2 Ad J: •? 
5 o ^ ^' 4= l-*3 It ^ 1^— > 7 5 M^c>^BIS 

§rJgjC&6<JI^^!?#;t^ t>«^X% 4S§a*iJ^Si5 3 a t-fe/W-ft; 
•^hy S':}';^3gJ^g|5 3btd-b«j5E$ttXV>5o 

X, ftg|*iJ^gB3 a fa, El4t;i^-rj;5l-fll^$tt, g| 

20 ISMSrfFW^mi: LX, tMt^^2 A^zXlO nhiv^ 
■:fuy^ tft-isft S IS)— * y 7J-«&#-r51limo<@|^$r 

*ij^-t--5 1 <oxfc t) , -fe/Wk-^ h y y ^ ;^s*?siJ 3 b 

y J/ ;^ ^ir^Wk^S 2 A--ttS;^ L.X±Mt^^ 2 A-Sr 

[0 0 2 8] /j:*5, El4JC;5%UfcleM*l|5tSB3 a tt, m 

5\:LXmm-t^m^mm (;^Xy7"A2~A8) lC*5lt 

-5SS^tbmc^sfjSLx^fjE!£$ix^tox% r.rx-tt, 4 
BBX4IBX1 6-&0;*>7 #;<7^7l 

AUd^-TipJ-x 7ttS;t)Kll~K44^co^^x8 
XS^aoBS^KBkiij (k = l~4, 1 = 1~4, i = 
1 — 8, j = 1 — 8) ds»bixS'b©i:i-<5o k, i r± 

i, j 7m;^lK^»~K«|c:t5V^X8 X 8iii 

— ^ (O fc* ©j2;fi |ci#^-r 5 ili^X-S) -5 d»Sr;T%-r 
xfc-So 

[0 0 2 9] *|IJS0iJXtt, ±Mt^nti:b^.<r> 

LXi:*>7Jdo# 1 X ipf^, 2x2®^, 4 
40 x4liS(0 3ffiiBo5*>(Oi/N-m*»Sr^J^i-.5t><Dt 

(DCT) ^1ll<01^-^' Xi5^;►J:oXV^X1> 

-en^'H 2 <osm(i/j:oxv^^ w b A^a* 

?"JiilSt)4 X4<0 2(03i*i: bXV^S, 
[O 0 3 0] @4{C*5V>Xs 1 1 a — 1 1 c ttBlf^O:?' 

D s' ^ Sr* iJ' V h LX^;* > 7ffi;^K.»~K«<^iii^K 

50 ttfcHiiiKBMijSraauioiftroKsSx— ^'Sraj:o-r 
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K 1 2 J: t) 5i3S ^ tu/c® ^ v^-- K B ux^i i J t> b < 

{cJ:9Si3St$ttfc||<o^*HfiSri: t) ABS (KB,cxi^- 
KBux-^iii) , ABS (KBuiii-KBw^ixij) SrfcB;^ 

b (oad^is 1 5 *5 xxj^mmmn 1 e j: 19 jewttig 

Hi (Om^mmiScS X8X4X3X2 b^J^i^ffiS: 

[0 0 3 1] */c. 1 8fia5£[Bl?Si 2 36^b<^W*7^— 
^ Sr ^ b i.^X/\ti $ tLfcili^<^ 2 oltfOM^T^^ 

2 oriROM2 l:6^C><?5jg^Jj:t*oTJftS5Sl 
X\ ROM2 iJ;id:2X2M^/i:*7<^<o-fe/^o^l^ 

tJiea-r^Bi^K Buaij<^ k , 1 , i , j ■ 

ffi;^i^n'5<t 5^^^^oXV^ao 2 2li-fel^i5^^ 2 035^b 
<0^<?:>S6^{fi^i: ABS (KBiciij-i-K 
Bui^iij) , ABS (KB,.ii^i3-KBu^ixij) Srm;'^ 

znh<DMm^2 3isxxj^mm^^2 4\^x9mMfm 30 

3SSS2 2*>?><?>^^>Oite>ttffi3&5S®^tt, |115(?:>:;^7"s/ 
y'A 2 (;i*5tt5 2 X 2mm/ 1 :^ ^ ^<7)-fe:/v(-■ov^TO 

H2 (?5ffiSrlB*»8 X8X4X1X2 T*^»L5pi?&ffi§r 

[0 0 3 2] 2 6«:iiM@SSl 8;d>e><^®^7^ 

M[Hi?s 2 6 {c<t 9 mm^ti'fcmm'f-^ t o^srts^-r 

5®SS§. 2 8ttROM2 9*^?><Oit^(Ct¥oT®3SfS^ 

T\ ROM2 9lCd:4 X4®*/l*7<^^^/^0*^ 
«C<a:g-r6M^KBuxi3<^k, 1, i, j {-§9-^-5 X — 

l/>5^>5^2 8;i-bfct5;^^tt. ^nW^^O^'&t-tt "O" 
ffi:^$tt^<t 9l->'i^oTV^6o 3 Ott-fel^iJ'^ 2 8;ii-?> 
coMt?5l&^fiISri: t) ABS (KBuxij-K 5( 
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B,cx^iij-3) , ABS (KBwxi3-KBu*xxi-33) Srffi 
;^)-r5J6*fffiS5^SS. 3lttA0iCS. 3 2«:a5{lH)^S 

X y y^A 2 tcis ^4X4 B^/ 1 ;^ 7« ^ (O-fev^i-^^io v^ 

;d5S|3i$tt5o 3 3d:mS^*-x?fe^l¥« 

glS^CH^ (Om^m^^ 8X2X3X4X2 X'^S 

[00 3 31 ^ . 3 4 tt^SSS 1 7, 2 5, 3 3 

S. 3 5ttitg5S3 4{c:J:5iti!?)g^^Stt 3o(^l¥fli 
ffiHx, Ha , H* <^9*><^SW-ffi^S*^bXfcB;^-r^ 

;\^^^y'' (1 X 1 t>U<«:2 X2 t>U<ri4 X4) 

-fe/Wt-^ h y :^ 3 b icixSS^Sn-fe 

[0 0 3 41 I2l2lC*^V^T. 4^^2^^(D^— :^ 

S: 1 ^5uJc^-^-r S fc«)<D 1 ^Sfc7c3fe'<#x.#S. 5 r:iii: 

2 »C7nii:5^^^^/cti 1 ^fe7t:E5^^^<^^ci6co3fe-^#XL 
Sr5ilSr>WJ-tTJ^i:5/ci?)(OtBBiW*^S. 6 1 ^ctcS^ 

^ t) — ::^x 2 »:7T;^e5^'^^Sr^T^c^ 9 1 ?k 

taM*iJffi:#S5«:. -fcyHk#^S2A3&^?>(07^-i5^ 

2i>cSii:?^^^^/ci^i»:7cii:i?^^^ 

^^2 Aji^fet^T"— :^c^tBBai-lSCT. 1 ^5c7cafc-<#x. 

#^4 2i5>:7CT^— ^^Oy^^^>:&^$rIll8 (a) 
— (c) (^v^-m^^O^-l':7•^c:^^9#;^'6 t^^^^T-fc^ 

[00351 ^ bX . 7 ri:^-f 6 Srilii Lfcx— 

7^-i5^SrS^^k-r5S^<t:5&. 9 AJiST-'it:5g8?6-6>co 
y^^^{cSctVX-^&^n^iti:mir-^^Mn^it^ (V 
LC) xfe5o m^(0:^^^ i^-h 

(DltitiYX. ir/Hb^S2 At^J:»9> IrI— {Se^/cri^f^S 
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So 

[O 0 3 61 «Sx&L:rcJ:5l-. 411X415-^1 

XSlSiOM^KBiciij (k=l'-4, i=l'-4, i = 
1 — 8, j=l~8) (mS(D:^Ty':/'A10 

fig) , ±Mt^rr^o^(ommt LT1:^^7^o# 1 

Xl®^, 2X2mM, 4 X4®^<D3SS(0 5*?^OV^ 
ML^blHl2S«J*cr>rtBI¥iJSgB3 a SrfflV^T. ^-t/V-^J'-Y 10 

Hi , Hz , H4 (ia5(0;^7^i/:7'A2# 

fig) o 

[0 0 3 71 ^<?5SS[^^mHi , Hz , H^ ^^th^^th 
^^^1 7, 2 5, 3 3{;!:±t)#^/v^^>^(0®^»X- 

H2 , H4 L (El5 0;^7"5'r7'A3#BB) , \t^^S 
4|cJ:^)Sffifli[Ha , H2 , H40:;^#^Sritg5U (El 
5<0><.7^5^:7'A4, A6#RS) ft/Hjtt?io:rcf?ffifflH 20 
it>U<«:H2 t>U<tiH^ Sr. -fei/:^^^^ 3 5(cj;!9a 
S^^L-cm^-f-^ (lli5(0;^7'i/:/A5, A7, A8# 
fig) o fFffifgHx , Hz , H^ '^Ofli:;^5,J^$V^g. 

[0 0 3 81 :i<DX'?\cLx. s smmmititi 

(lxitL<«:2X2t>L<B: 

4X4) m:i^'^^\-^^(om^m(o^m<o^<^ji^'^ 

TS«^$n^>'Hfe;^IS2A--ttl;^»$HSr:ir{j:J:*9. 1 30 
X i®^/l;^y me (a) 

5*-tyWl:>^t3 5,>>;5qf p,tt. 2 X 2®*/l;^7<^0 
±/\^<Dm^. me (b) {c*-r<t 5^j^-^>'Wt:^i=' s'iJ'ds 

?#e>tt. 4 X4ilf^/l*^70-fe/V(?>4i^. 06 
( c ) \:i7ik^X b fSi^Mtyti y ^ r h \^^^ 

[003 91 J: 5 LT-feyHt:5?n/cH^*-&(oy 

s\zx^. |gl7(c:^-r^>ll{ct¥oT. -fe7Wt:^S2Ad^ 
ii><D±Mtzf^ SB (x, y) rtO^^— i^<^*BB§S: 
*iJ*-rSo 0*9. •feyWk^ife2Afc:J:9t#6>ttfc-fe/w 

<t:/ni/:^^SB (x, y) (D x X y (DMB'T — ^ S B 
(i^l'-x, j=i-'y) {c:oV^T m7<o:^y'yy' 
Bl#Rg) . ^*r6jO*aBiVt«*rSi(OftBiHi:Sr-tn 
^*ttJ^Xix:/B2, B 3 <t 5 Ji^^iS^'t'So ^Ty 50 
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^•B2, B 3 ^tt^tt«:^f^, 

So 

[0 0 4 01 :i<^±5{-SiaL^ti/c+eSiv, H^. 
'ett^^?)K^$i^fcL^v^fflTHV, THHirltfe-TS 

(X^i/:7"B4, B5, B 8) o :^^7^S/:7"B4(CJ: 5 V 
>THVl:^JS$n^^iy>^'B 5lcJ: »9 H>THHt^J 

^$ti/cS^l;id:. "fe/v<k>^aiy:^SB(5^:&i^{ct>«| 

#x.^S4(?:>ffi;^Wc^!5#x.. l »C7Eafe-<#i^S4 
{dJ:'9Mx(ilil8 (a) (d^i-<fc5>'^©:5i'9lS#«o;^ 

iVcyt\^ik^^^hti C^Ty^Be) . E^gC^^7 
iciti l^5k7cii:3S^^:d5tT/jrt>ttSo 
[0 04 1] ;^T'2/:7*B4(cj:i9 v>THVi:^fiJ:^$n 

iy37-B 5 J: 19 H^THH^^lMj^^tLfc^-^JCli, 

•^/Htyt3 5,>5^SBd:«:;^ra]{ctBg3:65iSv>^2Hij»fL. ;^ 

y^e^x}kjtm-<m^^&i4.<r>mt}m\z.mK^m^. 
i^7t^-<m7L^^^\^x^ maxims (b) {c^t-ct 

3/i5'SB;65i2fe^{j:3fe-<^;t^tt (JX7"5/:7'B 

7 ) . a^s^^ms 7 fc i 19 1 »c7uii:^^^.;55tj/j^ t>tt 

So 

[004 2] l^^fC. :^^iy>'*B4{C^*9 V^THV^ 
*lJ^ $ tt;<7" 17^ B 8 id i 19 H > T H H t ^J^ $ ttfc^ 
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